Pragmatic Influences on Sentence Planning and Surface Realization: Implications for Evaluation
نویسنده
چکیده
Three questions to ask of a proposal for a shared evaluation task are: whether to evaluate, what to evaluate and how to evaluate. For NLG, shared evaluation resources could be a very positive development. In this statement I address two issues related to the what and how of evaluation: establishing a “big picture” evaluation framework, and evaluating generation in context.
منابع مشابه
An Integrated Approach to Multilingual Hypertext Generation
Text planning combines the tasks of content determination and discourse planning in order to construct a text plan from a suitably represented generation goal. The sentence planning step involves such tasks as sentence aggregation, referring expression generation, and sometimes lexicalization, and aims at converting text plans into sentence plans. Linguistic realization, finally, converts the s...
متن کاملSentence Processing Among Native vs. Nonnative Speakers: Implications for Critical Period Hypothesis
The present study intended to investigate the processing behavior of 2 groups of L2 learners of English (high and mid in proficiency) and a group of English native speakers on English active and passive reduced relative clauses. Three sets of tasks, an offline task, and 2 online tasks were conducted. Results revealed that the high-proficiency group’s performance was the same as that of the nati...
متن کاملSentence Generation as Planning with Probabilistic LTAG
We present PCRISP, a sentence generation system for probabilistic TAG grammars which performs sentence planning and surface realization in an integrated fashion, in the style of the SPUD system. PCRISP operates by converting the generation problem into a metric planning problem and solving it using an offthe-shelf planner. We evaluate PCRISP on the WSJ corpus and identify trade-offs between cov...
متن کامل: Stochastic Natural Language Generation 3 Natural Language Understanding Natural Language Generation Surface
We describe a corpus-based approach to natural language generation (NLG). The approach has been implemented as a component of a spoken dialog system and a series of evaluations were carried out. Our system uses n-gram language models, which have been found useful in other language technology applications, in a generative mode. It is not yet clear whether the simple n-grams can adequately model ...
متن کاملUsing Argumentation to Control Lexical Choice: A Functional Unification Implementation
Using Argumentation to Control Lexical Choice: A Functional Unification Implementation Michael Elhadad This thesis investigates the impact of the pragmatic situation on surface generation. It presents new surface generation techniques that improve on both aspects of surface generation: (1) lexical choice, which consists of choosing words and their associated syntactic structures and (2) syntact...
متن کامل